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TITLE OF THE INVENTION 

MAP DISPLAYING APPARATUS 

BACKGROUND OF THE INVENTION 
5 (1) Field of the Invention 

The present invention relates to a map displaying apparatus 
that displays a map on a screen, and in particular to a map displaying 
apparatus that generates a three-dimensional image from electronic 
map data and displays a map on a screen. 

10 

(2) Description of the Related Art 

A map displaying apparatus that generates a three-dimensional 
image from electronic map data and displays the image is 
conventionally available (see Japanese Laid-Open Patent Publication 
15 No. H09-281889, for example), and is applied, for example, to a car 
navigation apparatus or map displaying software for a personal 
computer. 

Also, map displaying apparatuses in recent years have not only 
a map displaying function but also an audio function. For this kind of 

20 map displaying apparatus, a graphic equalizer (see FIG. 2) or the like 
that displays the magnitudes of the outputted sounds in respective 
frequency bands is known as a means that displays information on 
sounds from an audio function on a screen. 

FIG. 1 is a block diagram showing part of the construction of a 

25 conventional map displaying apparatus. 

This map displaying apparatus includes a map data storing unit 
2101 that stores map data such as roads and topography, a map 
drawing data generating unit 2102 that fetches map data from the map 
data storing unit 2101 and generates map drawing data to be displayed 

30 on a screen, a sound data inputting unit 2103 that stores sound data 
such as magnitudes and frequency bands for sounds received from an 
audio function, a sound drawing data generating unit 2104 that 
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generates sound drawing data for a graphic equalizer or the like using 
sound data from the sound data inputting unit 2103, a drawing unit 
2105 that carries out a drawing process using image data generated by 
the map drawing data generating unit 2102 and the sound drawing 
5 data generating unit 2104 to generate an image on the screen, and a 
displaying unit 2106 that displays an image obtained from the drawing 
unit 2105 on a screen of a display or the like. 

Accordingly, in this kind of conventional map displaying 
apparatus, the information inputted by the sound data inputting unit 

10 2103 is drawn as sound drawing data for a graphic equalizer or the like 
by the sound drawing data generating unit 2104 and is then 
transferred to the drawing unit 2105, so that the sound drawing data 
and the map drawing data are generated separately. 

FIG. 2 is a diagram showing a case where a conventional map 

15 displaying apparatus displays map data and sound data 
simultaneously. 

As shown in FIG. 2, in a conventional map displaying apparatus, 
to display sound data like a graphic equalizer, it is necessary to provide 
a sound data display region 2203 as a separate region to a map data 

20 display region 2202 on a display screen 2201. The drawing unit 2105 
first draws the map generated in the map drawing data generating unit 
2102 on the entire display screen 2201 and then superimposes the 
sound data display generated in the sound drawing data generating 
unit 2104 on a sound data display region 2203 that is part of the 

25 screen. 

In a conventional map drawing apparatus, aside from the 
display method shown in FIG. 2, there is another display method that 
splits the display region of the screen into a map display rectangular 
region and a sound data display rectangular region and draws the map 
30 data and the sound data in the respective regions. 

In this way, with the conventional map displaying apparatuses 
described above, when sound data showing the sound quality of audio 
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or an audio input status is displayed on a screen, display is carried out 
with the screen split into a map data display region and a sound data 
display region or with the sound data display being superimposed on 
the map data display, so that in a normal map displaying apparatus 
5 that has a small display screen, there has been the problem that the 
display screen has been crowded and difficult to view. 

Also, in a conventional map displaying apparatus, since a sound 
data display region for displaying sound data outputted from an audio 
function is required, the map data display region is reduced, resulting 

10 in problems such as it being difficult for the user of the map displaying 
apparatus to make out the map display. This problem is especially 
serious for map displaying apparatuses such as car navigation 
apparatuses that have a relatively small screen. 

The present invention was conceived in view of the problems 

15 described above and it is an object of the present invention to provide 
a map drawing apparatus that can allow a user to visually grasp sound 
data, such as a sound quality and an audio input status, of audio from 
an audio function without reducing the map data display region on a 
screen of the map displaying apparatus. 

20 

SUMMARY OF THE INVENTION 

In order to solve the problems described above, a map 
displaying apparatus according to the present invention includes: a 
map data storing unit operable to store map data; a sound data 

25 obtaining unit operable to obtain sound data; and an image generating 
unit operable to generate map drawing data based on the map data 
stored in the map data storing unit and the sound data obtained from 
the sound data obtaining unit. 

The map data stored in the map data storing unit may be data 

30 relating to at least one three-dimensional object, and the image 
generating unit may change one of a shape and a position of the at 
least one three-dimensional object in accordance with changes in the 
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sound data. Here, the shape may be changed by changing a height of 
the at least one three-dimensional object. 

Also, the map data stored in the map data storing unit may be 
data relating to three-dimensional objects, and the image generating 
5 unit may change color data applied to the at least one 
three-dimensional object based on changes in the sound data. 

Also, the map data stored in the map data storing unit may be 
data relating to three-dimensional objects, and the image generating 
unit may change a display region for the at least one three-dimensional 
10 object on a screen based on changes in the sound data. 

In addition, the map data stored in the map data storing unit 
may be data relating to three-dimensional objects, and the image 
generating unit may carry out a process that shakes top vertices of the 
at least one three-dimensional object based on changes in the sound 
15 data. 

Also, the map data stored in the map data storing unit may be 
data relating to least one mountain object, and the image generating 
unit may change color data relating to colors of a mesh included in 
mesh data applied to the at least one mountain object based on 

20 changes in the sound data. 

It should be noted that the present invention can be realized not 
just by the map displaying apparatus described above but also by a 
map displaying method in which the units provided in such map 
displaying apparatus have been converted to steps. 

25 It should also be obvious that the above map displaying method 

can be realized by a program that is executed by a computer or the like, 
and that such program can be distributed using a recording medium 
such as a CD-ROM or via a transfer medium such as a communication 
network. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects, advantages and features of the 



- 4 - 



invention will become apparent from the following description thereof 
taken in conjunction with the accompanying drawings that illustrate 
specific embodiments of the invention. In the Drawings: 

FIG. 1 is a block diagram showing part of the construction of a 
5 conventional map displaying apparatus; 

FIG. 2 is a diagram showing a case where a conventional map 
displaying apparatus displays map data and sound data 
simultaneously; 

FIG. 3 is a block diagram showing part of the construction of a 
10 map displaying apparatus according to a first embodiment; 

FIG. 4 is a flowchart showing the procedure of the display 
process for three-dimensional objects that are to be displayed on a 
screen of the map displaying apparatus according to the first 
embodiment; 

15 FIG. 5 is a diagram useful in explaining a projection 

transformation process by a projection transformation unit; 

FIG. 6 is a diagram useful in explaining the altitude data; 

FIG. 7 is a diagram showing mesh data that represents a 
topographical shape; 
20 FIG. 8 is a flowchart showing the detailed procedure of S203 for 

the map displaying apparatus according to the first embodiment; 

FIGS. 9A and 9B are diagrams showing the screen of the map 
displaying apparatus according to the first embodiment; 

FIG. 10 is a block diagram showing part of the construction of a 
25 map displaying apparatus according to a second embodiment; 

FIG. 11 is a flowchart showing the procedure of the coloring 
process for three-dimensional building objects to be displayed on a 
screen of a map displaying apparatus according to the second 
embodiment; 

30 FIGS. 12A and 12B are diagrams showing a screen of the map 

displaying apparatus according to the second embodiment; 

FIG. 13 is a block diagram showing one part of the construction 
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of a map displaying apparatus according to a third embodiment; 

FIG. 14 is a flowchart showing a procedure for setting a display 
region of three-dimensional building objects in the map displaying 
apparatus according to the third embodiment; 
5 FIGS. 15A and 15B are diagrams showing the screen of the map 

displaying apparatus according to the third embodiment; 

FIG. 16 is a block diagram showing processing units provided in 
a map displaying apparatus according to a fourth embodiment; 

FIG. 17 is a flowchart showing a detailed procedure of S205 for 
10 the map displaying apparatus according to the fourth embodiment; 

FIGS. 18A and 18B are diagrams showing the screen of the map 
displaying apparatus according to the fourth embodiment; 

FIG. 19 is a block diagram showing part of the construction of 
the map displaying apparatus according to the fifth embodiment of the 
15 present invention; 

FIG. 20 is a flowchart showing a detailed procedure of S202 for 
the map displaying apparatus according to the fifth embodiment; 

FIGS. 21A and 21B are diagrams showing a screen of the map 
displaying apparatus according to the fifth embodiment of the present 
20 invention; and 

FIG. 22 is a block diagram showing part of the construction of a 
map displaying apparatus according to a sixth embodiment of the 
present invention. 

25 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A map displaying apparatus according to the present invention 
will now be described in detail with reference to the attached drawings. 
It should be noted that examples of the map displaying apparatus 
according to the present invention include a car navigation apparatus 
30 equipped with an audio function, a PDA equipped with an audio 
function, and a PC, with such apparatuses having an output function 
for sounds and a screen capable of displaying a map. 
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First Embodiment 

A map displaying apparatus according to a first embodiment of 
the present invention changes the height of three-dimensional building 
5 objects that are map display objects displayed on a screen in 
accordance with magnitudes, frequency components and the like of 
sounds. By doing so, it is possible for the user of the map displaying 
apparatus to visually grasp the sound quality of audio and audio input 
status at the same time as a map. It should be noted that although 

10 the sound data used in the embodiments described below is the 
magnitude S of sounds, the sound data is not limited to the magnitude 
S and other data such as data relating to frequency bands showing 
high and low sounds is also conceivable. FIG. 3 is a block diagram 
showing part of the construction of the map displaying apparatus 

15 according to the first embodiment. 

The map displaying apparatus according to the first 
embodiment includes a map data storing unit 101 that stores map data 
such as position information and height information of objects to be 
displayed on a screen, a map drawing data generating unit 102 that 

20 obtains map data from the map data storing unit 101 and sound data 
from a sound data inputting unit 103 and generates map drawing data 
such as shape data for objects, the sound data inputting unit 103 that 
stores a plurality of sound data composed of magnitude values and the 
like for respective frequency bands of sounds outputted from an audio 

25 function and also inputs sound data into the map drawing data 
generating unit 102, a drawing unit 104 that carries out a drawing 
process for the map drawing data generated by the map drawing data 
generating unit 102 and generates images to be displayed on the 
screen, and a displaying unit 105 that displays the images generated 

30 by the drawing unit 104 on an actual screen such as a display. 

The map data storing unit 101 stores map data composed of 
data such as position information of roads, urban areas, topography, 
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and the like to be displayed on the screen expressed using longitudes 
and latitudes, height information and attribute information, 
three-dimensional building data composed of heights and boundary 
rectangle information of three-dimensional objects to be displayed on 
5 the screen, and altitude information composed of heights of lattice 
vertices in the longitude and latitude directions showing an undulating 
shape of a land surface. 

In the first embodiment, the map data storing unit 101 stores 
three-dimensional building data composed of heights H of buildings 

10 that are three-dimensional objects, numbers of vertices N of N-gonal 
prisms that compose boundary rectangles of buildings, vertex 
coordinates Xi (where i = l to n), and attributes and the like. Here, the 
vertex coordinates Xi of the N-gonal prism shapes of buildings are 
assumed to be two-dimensional coordinates. In addition, surface 

15 information such as an index composed of colors, textures, and 
surfaces is used as the attributes for drawing the N-gonal prism shapes 
of buildings. 

Based on map data from the map data storing unit 101 and 
sound data from the sound data inputting unit 103, the map drawing 

20 data generating unit 102 generates map drawing data composed of (a) 
shape data composed of (i) coordinates of element vertices composing 
surfaces, lines, points and the like of three-dimensional objects and (ii) 
connection information for the element vertices, and (b) drawing 
information such as color values and texture images for drawing 

25 objects. Also, in the case where three-dimensional objects are 
formed of meshes, the map drawing data generating unit 102 
generates mesh data composed of information on mesh shapes and 
colors. The map drawing data generating unit 102 is composed of an 
object generating unit 102a, a local coordinate transforming unit 102b, 

30 and a model view transforming unit 102c. 

The object generating unit 102a carries out a generation 
process for three-dimensional objects, such as buildings, to be 
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displayed on the screen using map data such as latitude/longitudes, 
height information, and building types. In the case where the 
three-dimensional objects to be displayed on the screen are N-gonal 
prism shapes, the object generating unit 102a fetches 
5 three-dimensional building data stored in the map data storing unit 
101 and finds 2xN three-dimensional vertex coordinates Yi (where i = l 
to n) and Zi (where i = l to n) that construct the N-gonal prism shapes 
of buildings. Here, Yi are vertex coordinates that compose a lower 
surface on a plane at the height zero of the N-gonal prism, while Zi are 

10 vertex coordinates that compose an upper surface on a plane at a 
height H of the N-gonal prism. It should be noted that the respective 
vertex coordinates of the three-dimensional objects found by the 
object generating unit 102a are referred to as "local coordinates" in a 
coordinate systems centered on a three-dimensional object. 

15 In addition, the object generating unit 102a finds an 

arrangement of vertex numbers that construct N side surfaces and a 
single upper surface. The colors and textures of each surface that are 
drawing information are assigned according to the orientation of a 
normal of each surface. It should be noted that when drawing 

20 information is included in the three-dimensional building data in 
advance, the object generating unit 102a assigns the color and texture 
of each surface based on the three-dimensional building data. In 
addition, although the first embodiment is described with 
three-dimensional building data being shown as the map data, there is 

25 also a case where altitude data, which is composed of the heights of 
lattice vertices in the latitude and longitude directions and expresses 
the undulating shape of a land surface, is handled, with this case being 
described later in a fifth embodiment of the present invention. 

It should be noted that when texture data is included in the 

30 drawing data, the object generating unit 102a can also carry out a 
texture data changing process that selects texture data of respective 
surfaces of three-dimensional building objects to be displayed on the 
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screen from a plurality of textures and/or edits some or all of the 
texture data based on the sound data obtained from the sound data 
inputting unit 103. For example, a method that divides a domain that 
can be assumed by the sound data obtained from the sound data 
5 inputting unit 103 into a plurality of regions and assigns a texture 
number to each of the divided regions could conceivably be used as the 
method of selecting the texture data by the object generating unit 
102a. 

The local coordinate transforming unit 102b carries out a shape 

10 data changing process for three-dimensional objects generated from 
the map data in the object generating unit 102a, based on the sound 
data obtained from the sound data inputting unit 103. More 
specifically, the local coordinate transforming unit 102b changes a 
local coordinate transformation matrix using the magnitude S of 

15 sounds that is the sound data obtained from the sound data inputting 
unit 103. This local coordinate transformation matrix is a matrix for 
carrying out a transformation from a coordinate system centered on a 
three-dimensional object to a global coordinate system that is a larger 
coordinate system. 

20 In this way, the local coordinate transforming unit 102b changes 

the local coordinate transformation matrix based on the magnitude S 
of sounds, so that the heights of the three-dimensional building 
objects that are displayed on the screen change in accordance with the 
magnitude S of sounds. 

25 A model view transforming unit 102c determines, from 

distances between viewpoint coordinates expressing a viewpoint and 
global coordinates of respective vertices of the three-dimensional 
building objects and the like, at what position and how large the 
three-dimensional objects that are models will be displayed. More 

30 specifically, the model view transforming unit 102c carries out a 
process that transforms the coordinates of each vertex of 
three-dimensional objects in the global coordinate system to a 
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viewpoint coordinate system using a model view transformation matrix. 
The viewpoint coordinates are one point in the global coordinate 
system, and can be set for example according to an indication from the 
user or based on a present position (i.e., a vehicle position) of a 
5 moving body in which the map displaying apparatus has been fitted. 

The shape data changing process for three-dimensional objects 
carried out by the map drawing data generating unit 102 transforms all 
of the vertex coordinates Q (X, Y, Z, 1) that compose the shape data 
included in the map drawing data to three-dimensional coordinates Q 

10 \X', Y', Z', 1) using a shape data changing matrix having four rows and 
four columns. It should be noted that the elements in the fourth row 
of the vertex coordinates Q (X, Y, Z, 1) during transformation and the 
vertex coordinates Q \X', Y', Z', 1) after transformation are all ones so 
that the effects of translating elements in the shape data changing 

15 matrix can be realized. 

The sound data inputting unit 103 stores sound data such as 
music outputted from an audio function or the like provided in the map 
displaying apparatus a ccording to the present invention and also 
inputs the sound data into the local coordinate transforming unit 102b 

20 included in the map drawing data generating unit 102. 

The sound data stored in the sound data inputting unit 103 is 
normally updated at intervals of a fixed time. In addition, it is 
possible for the sound data to include parameters showing the user's 
tastes and a genre for music. 

25 The drawing unit 104 generates an image to be displayed on the 

screen by carrying out a drawing process that transforms and projects 
the three-dimensional map drawing data processed by the map 
drawing data generating unit 102 onto the actual two-dimensional 
screen. In the first embodiment, the drawing unit 104 includes a 

30 projection transformation unit 104a and a viewport transformation unit 
104b. 

The projection transformation unit 104a sets a projection 
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transformation matrix for respective vertex coordinates of 
three-dimensional objects in the viewpoint coordinate system set by 
the model view transforming unit 102c, and carries out a projection 
transformation process that projects the respective vertex coordinates 
5 of the three-dimensional objects onto the two-dimensional screen. 
This projection transformation process projects onto a screen 
transformed to a coordinate system centered on the viewpoint 
coordinates where the viewpoint direction is a positive direction in the 
Z axis. The projection transformation unit 104a carries out a process 

10 that specifies clip coordinates and trims lines and surfaces of objects 
that extend beyond a viewing pyramid including the viewpoint 
coordinates and the clip coordinates. 

FIG. 5 is a diagram useful in explaining the projection 
transformation process by the projection transformation unit 104a. 

15 As shown in FIG. 5, a drawing region 301 and map drawing data 302 
are displayed in a three-dimensional coordinate system in the global 
coordinate system. 

The projection transformation unit 104a determines a 
projection transformation matrix M with four rows and four columns 

20 that is determined from a viewpoint 303 disposed at a position 
corresponding to the viewpoint coordinates and a gaze vector. The 
projection transformation unit 104a also carries out a matrix 
transformation of a three-dimensional coordinate system for 
three-dimensional building objects and the like using the projection 

25 transformation matrix M, thereby transforming the three-dimensional 
coordinates to a coordinate system on a two-dimensional screen 304. 
As a result, the positions on the screen at which the respective 
coordinates of three-dimensional building objects are to be disposed 
are decided, and an image 305 that has been projected onto the screen 

30 304 of the map displaying apparatus is displayed. It should be noted 
that during the projection transformation, it is normal to draw objects 
close to the viewpoint 303 large and objects far from the viewpoint 
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small. 

The projection transformation unit 104a carries out a fill process 
for each surface of the three-dimensional object based on the vertex 
coordinate data subjected to the projection transformation process. 
5 In this fill process, the projection transformation unit 104a carries out 
a hidden surface removal process based on depth information from the 
viewpoint called "Z values" t hat are calculated by the projection 
transformation process. This hidden surface removal process detects 
objects and surfaces that cannot be seen from the viewpoint 303 and 

10 prevents such objects and surfaces from being drawn. Possible 
methods for realizing this hidden surface removal process include a Z 
buffer method that assigns depth information in units of each pixel in 
the display screen, judges depth information for each pixel during 
drawing, and draws only the nearest objects and a Z sort method that 

15 rearranges the surfaces to be drawn in order in the depth direction and 
draws the surfaces starting from the surface furthest from the 
viewpoint. 

It should be noted that although the projection transformation 
unit 104a has been described as transforming the respective 

20 coordinate vertices of the three-dimensional object to two-dimensional 
screen coordinates using a projection transformation matrix M from 
the predetermined viewpoint 303, a target point position, and the like, 
it is also conceivably possible to carry out a projection transformation 
matrix generation process that generates a projection transformation 

25 matrix M' based on sound data obtained from the sound data inputting 
unit 103 and uses this projection transformation matrix M' to transform 
the respective coordinate vertices of the three-dimensional objects to 
two-dimensional screen coordinates. Such transformation is 
described later in a sixth embodiment of the present invention. 

30 Also, FIG. 6 is a diagram useful in explaining the altitude data. 

The map data storing unit 101 stores altitude values Hxy (402) 
corresponding to altitude reference points Pxy (401) that are lattice 
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points on an XY plane. In this case, the map drawing data generating 
unit 102 generates mesh data representing a topographical shape from 
four adjacent altitude reference points Pxy, P(x+l)y, Px(y+1), and 
P(x+l)(y+l) and four adjacent altitude values Hxy, H(x+l)y, Hx(y+1), 
5 and H(x+l)(y+l). 

FIG. 7 is a diagram showing mesh data 501 that represents a 
topographical shape. The map drawing data generating unit 102 
generates the mesh data 501 representing the topographical shape 
using data for the altitude reference points and altitude values. Like 
10 the N-gonal prism data described above, this mesh data 501 is data 
composed of drawing data and the like for three-dimensional vertex 
coordinates, vertex number arrangements composing surfaces, colors, 
and textures. 

The viewport transformation unit 104b carries out a matrix 

15 transformation of all vertex coordinates of three-dimensional objects 
using a viewport transformation matrix after the projection 
transformation in the projection transformation unit 104a in order to 
transform to an appropriate size of the target display region on the 
screen of the map displaying apparatus. Here, a "viewport" refers to 

20 a rectangular region with a height and width that are smaller than the 
screen. The viewport transformation unit 104b changes the 
coordinates that are subjected to the viewport transformation to 
screen coordinates (Sx,Sy) that are coordinates on the 
two-dimensional screen. 

25 The displaying unit 105 obtains the screen coordinates (Sx,Sy) 

determined in the viewport transformation unit 104b and displays the 
drawing data on a display or the like that is the actual screen of the 
map displaying apparatus. 

Next, the display process procedure for three-dimensional 

30 objects carried out by the map displaying apparatus according to the 
first embodiment will be described. FIG. 4 is a flowchart showing the 
procedure of the display process for three-dimensional objects that are 
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to be displayed on the screen of the map displaying apparatus 
according to the first embodiment 

First, the object generating unit 102a reads surface information 
including vertex coordinates (for example, coordinates (X,Y,Z,1)), 
5 color data, texture data, an index that constructs surface data, and the 
like that are map data of objects stored in the map data storing unit 
101 (S201). After this, the object generating unit 102a fetches 
position information, such as a latitude and longitude of each vertex of 
polygons of buildings to be generated on the screen a nd height 

10 information for each vertex obtained from the map data storing unit 
101, and by applying the position information and height information 
to each vertex of the polygons of the buildings, generates 
three-dimensional building objects to be displayed as N-gonal prism 
data (S202). Also, the object generating unit 102a carries out a 

15 coloring process for surfaces and the like of three-dimensional building 
objects based on the map data. 

Next, the local coordinate transforming unit 102b carries out a 
transformation process for a local coordinate matrix using sound data 
obtained from the sound data inputting unit 103 (S203), and also 

20 obtains local coordinates (X,Y,Z,1) for each vertex from the object 
generating unit 102a and sets global coordinates (X',Y',Z',1) by 
carrying out a matrix transformation using the matrix that has been 
transformed (S204). 

The model view transforming unit 102c sets a model view 

25 transformation matrix for transforming the global coordinate system to 
the viewpoint coordinate system, which defines drawing positions, 
sizes, and the like of three-dimensional objects from global 
coordinates and the viewpoint position, and transforms coordinates 
from the global coordinate system to the viewpoint coordinate system 

30 using the model view transformation matrix (S205 and S206). At this 
point, not just the respective vertex coordinates of the 
three-dimensional objects but also viewpoint coordinates, light 
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sources, and other information required for positional relationships 
and the like are arranged in the viewpoint coordinate system. 

The projection transformation unit 104a determines the 
projection transformation matrix M for projecting three-dimensional 
5 objects onto a two-dimensional screen, and also carries out a matrix 
transformation process for transforming viewpoint coordinates to 
- screen coordinates. (S207). It should be noted that at this time, the 
projection transformation unit 104a sets the clip coordinates for 
removing lines and surfaces of objects that are not required (S208). 

10 The viewport transformation unit 104b transforms respective 

coordinates of three-dimensional objects using a viewport 
transformation matrix in order to make the display positions and sizes 
of the three-dimensional objects suitable for the actual display screen 
(S209), and finally sets the screen coordinates that are coordinates on 

15 the screen of the map displaying apparatus (S210). 

FIG. 8 is a flowchart showing the detailed procedure of S203 for 
the map displaying apparatus according to the first embodiment. It 
should be noted that this first embodiment describes the case where 
the heights H of three-dimensional building objects displayed on the 

20 screen of the map displaying apparatus change in accordance with the 
magnitude S of sounds. 

First, the object generating unit 102a divides the screen into 
regions in which the three-dimensional building objects are to be 
displayed in accordance with the screen of the map displaying 

25 apparatus (S601 and S602). In a case where the sound is divided into 
N equal frequency bands and the magnitude of the sound in each 
frequency band is also divided into N equal divisions, for example, this 
division into regions divides the region of the screen into N equal parts 
in the horizontal direction and the region above the map into N equal 

30 parts in the vertical direction. It should be noted that it is not always 
necessary to carry out such division into regions, and when objects are 
changed uniformly in accordance with the sound, such division is not 
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required. The local coordinate transforming unit 102b of the map 
drawing data generating unit 102 also transforms local coordinates 
using a local coordinate transformation matrix that is different for each 
region. 

5 Next, the object generating unit 102a reads respective vertex 

coordinates of three-dimensional building objects on a 
region-by-region basis (S603). The local coordinate transforming 
unit 102b changes the vertex coordinates so that the heights H of 
three-dimensional building objects are changed to heights H' (where 

10 H ' =SxH) that are proportionate to the magnitude S of sounds (here, 
the case where the magnitude S has been normalized so as to be in a 
range of 0 to 1 is described) (S604). 

To change the vertex coordinates, the local coordinate 
transforming unit 102b changes the local coordinate transformation 

15 matrix using the magnitude S of the sound obtained from the sound 
data inputting unit 103 (S605). Using this changed matrix, vertex 
coordinates of three-dimensional objects are transformed to values 
that are proportionate to only a second row, second column component 
that is a scale component for the magnitude S of the sound and the 

20 heights H of the buildings. The remaining components are set with 
the same values as the identity matrix, so that the local coordinate 
transforming unit 102b carries out a transformation in the direction of 
the heights H only in accordance with the magnitude S of the sound 
(S606). 

25 Next, the local coordinate transforming unit 102b ends the loop 

of the vertex coordinate changing process (S607). The object 
generating unit 102a also ends the loop of the reading process for 
vertex coordinates (S608). 

In this way, in the map displaying apparatus according to the 

30 first embodiment, vertex coordinates of three-dimensional objects 
generated by the object generating unit 102a are subjected to a local 
coordinate transformation using a local coordinate transformation 
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matrix that has been changed in accordance with the magnitude S of 
sounds, so that the heights H of three-dimensional objects can be 
changed in accordance with the magnitude S of sounds. 

FIGS. 9A and 9B are diagrams showing the screen of the map 
5 displaying apparatus according to the first embodiment. For example, 
FIG.9A shows the case where the magnitude S of sounds is large, while 
FIG. 9B shows the case where the magnitude S of sounds is small. On 
a screen 701 of the map displaying apparatus in FIG. 9A, a group of 
buildings 702 are displayed along roads, while on a screen 701 of the 

10 map displaying apparatus in FIG. 9B, a group of buildings 703 are 
displayed along roads. 

The group of buildings 702 and the group of buildings 703 
displayed on the screen of the map displaying apparatus according to 
the first embodiment are displayed with their heights having been 

15 changed in accordance with the magnitude S of sounds as can be 
understood by comparing FIGS. 9A and 9B. 

In this way, according to the map displaying apparatus 
according to the first embodiment, the heights H of three-dimensional 
building objects that are map display objects can be changed according 

20 to sound data composed of magnitudes of sounds, frequency 
components, and the like, so that the user of the map displaying 
apparatus can visually grasp the sound quality and audio input status 
at the same time as the map display. Since the heights H of 
three-dimensional building objects rise and fall in accordance with the 

25 magnitude S of the outputted sounds, a more versatile display can be 
realized, and a map displaying apparatus that is more entertaining for 
the user can be provided. 

Second Embodiment 
30 Next, a second embodiment according to the present invention 

will be described. In the second embodiment, the case where the 
colors of three-dimensional building objects displayed on the screen of 
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the map displaying apparatus are changed in accordance with the 
magnitude S of sounds will be described. 

FIG. 10 is a block diagram showing part of the construction of a 
map displaying apparatus according to the second embodiment. The 
5 construction of the map displaying apparatus according to the second 
embodiment is the same as that of the various processing units of the 
first embodiment described above, but in the second embodiment, the 
sound data from the sound data inputting unit 103 is obtained by the 
object generating unit 102a. 

10 The object generating unit 102a obtains the sound data fetched 

from the sound data inputting unit 103 and carries out a color data 
changing process that applies the sound data to three-dimensional 
objects in accordance with a predetermined function that changes 
some or all of a plurality of elemental values (such as a blue component, 

15 a red component, a green component, and transparency) of color data 
included in map data obtained from the map data storing unit 101. 

For example, the object generating unit 102a carries out a 
changing process for color data to be applied to three-dimensional 
building objects using a function in which three components (for 

20 example, magnitude of sound, and sound frequency) selected from the 
sound data inputted into the object generating unit 102a from the 
sound data inputting unit 103 are respectively proportionate to three 
components of colors (such as a red component, green component, 
and blue component). 

25 Accordingly, with the map displaying apparatus according to the 

second embodiment, the object generating unit 102a obtains map data 
from the map data storing unit 101 and sound data from the sound 
data inputting unit 103, and can carry out a coloring process for 
three-dimensional objects in accordance with the sound data. 

30 FIG. 11 is a flowchart showing the procedure of the coloring 

process for three-dimensional building objects to be displayed on the 
screen of a map displaying apparatus according to the second 
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embodiment. This flowchart shows the detailed procedure of S202 in 
FIG. 2. 

The object generating unit 102a carries out division into regions 
for the screen on which the three-dimensional building objects are to 
5 be displayed in accordance with the screen of the map displaying 
apparatus (S901 and S902). The processing in this division into 
regions is the same as in the case shown in FIG. 8. 

Next, the object generating unit 102a reads vertex coordinates 
of three-dimensional building objects included in the divided regions 

10 from the map data storing unit 101 (S903). The object generating 
unit 102a carries out a coloring changing process for 
three-dimensional building objects using the sound data obtained from 
the sound data inputting unit 103 (S904). First, the object generating 
unit 102a obtains a roof color A and a base vertex color A of a 

15 three-dimensional building object by reading surface information of 
the three-dimensional building object from the map data storing unit 
101 (S905). The object generating unit 102a changes the color A' of 
the base vertex of the three-dimensional building object using the roof 
color A and the sound data obtained from the sound data inputting unit 

20 1 03 according to the following equation (S906). 

Base vertex color A'=A+BxS (here, B is a different color to A) 

Here, the magnitude S of sounds is a normalized value in a 
25 range of 0 to 1, for example. 

Next, the object generating unit 102a determines intermediate 
colors by producing a gradation or the like for the color A of the roof of 
the three-dimensional building object and the base vertex color A' 
(S907). Next, the object generating unit 102a applies the color data 
30 of the respective surfaces of the three-dimensional building object 
based on the changed color data (S908). 

After this, the object generating unit 102a completes the loop of 
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the coloring changing process for the three-dimensional building 
objects displayed on the screen (S909), and the object generating unit 
102a also completes the loop of the read process for respective vertex 
coordinates from the map data storing unit 101 (S910). 
5 This means that the object generating unit 102a can carry out a 

coloring changing process for color data to be applied to 
three-dimensional objects using the map data obtained from the map 
data storing unit 101 and the sound data obtained from the sound data 
inputting unit 103. 

io FIGS. 12A and 12B are diagrams showing the screen of the map 

displaying apparatus according to the second embodiment. FIGS.12A 
and 12B are diagrams showing cases where the magnitude S of sounds 
differs. On a screen 1001 of the map displaying apparatus in FIG. 12A, 
a group of buildings 1002 are displayed along roads, while on a screen 

15 1001 of the map displaying apparatus in FIG. 12B, a group of buildings 
1003 are displayed along roads. 

Out of the colors of the group of buildings 1002 displayed on the 
screen 1001 of the map displaying apparatus, the colors of the roofs 
and the base vertices are changed in accordance with the magnitude S 

20 of the sounds. The color of the roofs is red, for example, and the color 
of the base vertices is blue, for example. The intermediate colors of 
the buildings depict a gradation between the color of the roofs and the 
color of the base vertices. The colors of the group of buildings 1003 
shown in FIG. 10B change in the same way in accordance with the 

25 magnitude S of sounds. 

In this way, according to the map displaying apparatus 
according to the second embodiment, it is possible to change the colors 
of three-dimensional building objects that are map display objects 
based on an input of sound data composed of the magnitude of sounds, 

30 frequency components, or the like, so that the user of the map 
displaying apparatus can visually grasp the sound quality of the audio 
and the audio input status at the same time as the map display. Also, 
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since the map displaying apparatus according to the second 
embodiment can attractively change the colors of buildings in 
accordance with changes in sounds, a more versatile display can be 
realized. 

5 

Third Embodiment 

Next, a third embodiment according to the present invention will 
be described. In the third embodiment, the case where a display 
region of three-dimensional building objects displayed on the screen of 

10 the map displaying apparatus is changed in accordance with the 
magnitude S of sounds will be described. 

FIG. 13 is a block diagram showing one part of the construction 
of a map displaying apparatus according to the third embodiment. It 
should be noted that this block diagram of the map displaying 

15 apparatus according to the third embodiment is the same as the block 
diagram according to the second embodiment, so detailed description 
thereof has been omitted. 

FIG. 14 is a flowchart showing a procedure for setting a display 
region of three-dimensional building objects in the map displaying 

20 apparatus according to the third embodiment. It should be noted that 
a case where the height of the screen of the map displaying apparatus 
is set as a screen height WH and a value for determining a 
three-dimensional display region to be displayed on the screen is set as 
a screen threshold Y will be described in the third embodiment. 

25 The object generating unit 102a divides the screen on which 

three-dimensional building objects are to be displayed into regions in 
accordance with the screen of the map displaying apparatus (S1201 
and S1202). The processing in this division into regions is the same 
as described above. 

30 Next, the map drawing data generating unit 102 performs a 

calculation of the screen threshold Y according to the following 
equation. It should be noted that the magnitude S of the sound is 
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assumed to be a normalized value in a range of 0 to 1. 

Y=(l-S)xWH(S1203) 

5 The object generating unit 102a calculates the screen threshold 

Y according to the above equation and designates a region for 
displaying three-dimensional building objects on the screen (S1204). 
Next, the object generating unit 102a obtains map data such as 
latitudes and longitudes, height information for buildings, building 

10 types, and the like from the map data storing unit 101 and carries out 
a generation process for three-dimensional objects for the screen 
region that is not included in the calculated screen threshold Y, and 
also carries out a process that sets the number of vertices at zero and 
number of surfaces at zero for three-dimensional building objects in 

15 the screen region included in the calculated screen threshold Y 
(S1205). The object generating unit 102a then ends the loop of the 
generation process for three-dimensional building objects to be 
displayed on the screen (S1206). 

This means that the object generating unit 102a of the third 

20 embodiment can determine the screen threshold according to sound 
data obtained from the sound data inputting unit 103 and indicate a 
region where three-dimensional objects are to be generated and a 
region where three-dimensional objects are not to be generated. 

FIGS. 15A and 15B are diagrams showing the screen of the map 

25 displaying apparatus according to the third embodiment. On a screen 
1301 of the map displaying apparatus shown in FIGS. 15A and FIG. 
15B, a perspective view of a town is shown. It should be noted that 
although in FIG. 15A and FIG. 15B, the change in the 
three-dimensional object region is carried out in an up-down direction 

30 for the screen, this is not a limitation for the present invention, and the 
region can be changed in any direction, such as a left-right direction. 
It is also possible to divide the screen into regions in the horizontal 
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direction, for example, and to change the three-dimensional display 
regions of the screen separately for different frequency bands. 

Here, the screen height WH (1304) and the screen height WH 
(1307) are the dimensions in the height direction of the display or the 
5 like of the map displaying apparatus, the screen threshold Y (1302) 
and the screen threshold Y (1305) are values for determining a 
three-dimensional display region, and a section line 1303 and a section 
line 1306 on the screen show upper limits of regions in which 
three-dimensional objects are to be displayed in accordance with the 

10 screen thresholds Y. 

In FIG. 15B, the magnitude S of the sounds differs to the case 
shown in FIG. 15A and as the magnitude S of sounds approaches zero, 
the screen threshold Y (1305) approaches the screen height WH 
(1307), and the section line 1306 is changed to a position below the 

15 section line 1303. That is, as shown in FIGS. 13A and 13B, the display 
region for three-dimensional objects changes in accordance with 
changes in the magnitude S of sounds. 

Accordingly, according to the map displaying apparatus 
according to the present embodiment of the invention, the display 

20 region of three-dimensional objects that are map display objects is 
changed according to an input of sound data composed of a magnitude 
of sounds, frequency components, and the like, so that the user of the 
map displaying apparatus can visually grasp the sound quality of the 
audio and the audio input status at the same time as the map display. 

25 Also, since the display region for three-dimensional objects displayed 
by the map displaying apparatus is changed in the up-down direction of 
the screen in accordance with sounds, a map displaying apparatus with 
a more versatile display screen can be realized. 

30 Fourth Embodiment 

Next, a fourth embodiment will be described. The case where 
the map displaying apparatus according to the fourth embodiment 
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carries out a process that shakes the upper vertices of 
three-dimensional building objects displayed on the screen in a 
left-right direction in accordance with the magnitude S of sounds will 
be described. 

5 FIG. 16 is a block diagram showing the processing units 

provided in the map displaying apparatus according to the fourth 
embodiment. The map displaying apparatus according to the fourth 
embodiment is characterized by the sound data inputting unit 103 
inputting sound data into the model view transforming unit 102c. 

10 FIG. 17 is a flowchart showing a detailed procedure of S205 for 

the map displaying apparatus according to the fourth embodiment. 

The object generating unit 102a divides the screen in which 
three-dimensional building objects are to be displayed into regions in 
accordance with the screen of the map displaying apparatus (S1501 

15 and S1502). Next, the object generating unit 102a reads vertex 
coordinates for three-dimensional building object models included in 
the divided regions (S1503). The model view transforming unit 102c 
also changes the vertex coordinates so that upper vertices of the 
three-dimensional building objects are displayed having been "shaken" 

20 left and right in accordance with the magnitude S of sounds (S1504). 

First, the local coordinate transforming unit 102b transforms 
the local coordinates of the various vertices of three-dimensional 
objects to coordinates in a global coordinate system using a local 
coordinate transformation matrix. The model view transforming unit 

25 102c obtains a matrix Z that is a result of multiplication of a matrix 
after local coordinate transformation and a model view transformation 
matrix (S1505). 

Next, the model view transforming unit 102c carries out a 
changing process for the resulting matrix Z based on the sound data 

30 obtained from the sound data inputting unit 103 (S1506). In this 
changing process for the matrix Z, a value that makes a translation 
component (second row, third column element) for height scale 
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components proportionate to the magnitude S of sounds is set, and the 
remaining components are set as the same values as the identity 
matrix, so that upper vertices of three-dimensional building objects 
can be translated. 

5 Next, the model view transforming unit 102c ends the loop of 

the changing process for vertex coordinates of the three-dimensional 
building objects (S1507), and the object generating unit 102a ends the 
read process for vertex coordinates (S1508). 

In this way, in the map displaying apparatus according to the 

10 fourth embodiment, the model view transforming unit 102c changes, 
in accordance with the magnitude S of sounds, a matrix Z resulting 
from multiplication of a matrix after local coordinate transformation 
and the model view transformation matrix, so that a process that 
shakes the upper vertices of three-dimensional building objects in a 

15 left-right direction in accordance with the magnitude S of sounds can 
be carried out. 

FIGS. 18A and 18B are diagrams showing a screen of the map 
displaying apparatus according to the fourth embodiment. As shown 
in FIGS. 18A and 18B, this map displaying apparatus according to the 

20 fourth embodiment has the upper vertices of three-dimensional 
building objects displayed on the screen so as to shake in a left-right 
direction in accordance with the magnitude S of sounds from an audio 
apparatus or the like. 

On a screen 1601 of the map displaying apparatus in FIG. 18A, 

25 a group of buildings 1602 are displayed along roads. On the screen 
1601 of the map displaying apparatus in FIG. 18B, a group of buildings 
1603 are displayed along roads. As can be seen by comparing FIGS. 
18A and 18B, the group of buildings 1602 and the group of buildings 
1603 displayed on the screen of the map displaying apparatus are 

30 displayed so as to shake in the left-right direction in accordance with 
the magnitude S of sounds. 

In this way, according to the map displaying apparatus 
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according to the fourth embodiment, three-dimensional building 
objects that are map display objects are displayed so as to shake 
according to sound data composed of magnitudes of sounds, frequency 
components, and the like, so that the user of the map displaying 
5 apparatus can visually grasp the sound quality of the audio and the 
audio input status at the same time as the map display. Also, the 
display screen of the map displaying apparatus of the present 
invention is more versatile, making the map displaying apparatus more 
entertaining for users. 

10 

Fifth Embodiment 

Next, a fifth embodiment of the present invention will be 

described. A map displaying apparatus according to the fifth 

embodiment is described for the case where a color changing threshold 
15 I for mountain objects displayed on the screen is changed in 

accordance with the magnitude S of sounds. It should be noted that 

in the fifth embodiment, the case where mountain objects are 

generated from mesh data showing a topographical form, such as that 

shown in FIG. 6 and FIG. 7 described earlier is described. The color 
20 changing threshold I is a value for setting a change line for colors of a 

mountain that is set in proportion with an altitude value from the 

summit of a mountain object, for example. 

FIG. 19 is a block diagram showing part of the construction of 

the map displaying apparatus according to the fifth embodiment of the 
25 present invention. The map displaying apparatus according to the 

fifth embodiment is constructed of the same processing units as the 

second embodiment described earlier. 

FIG. 20 is a flowchart showing a detailed procedure of S202 for 

the map displaying apparatus according to the fifth embodiment. 
30 The object generating unit 102a reads altitude value data 

included in mountain objects and altitude reference point data (S1801). 

The object generating unit 102a obtains sound data inputted from the 
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sound data inputting unit 103 and changes the color changing 
threshold I of the mountain object based on the sound data according 
to the equation below. 

5 I=SxHconst(S1802) 

Here, Hconst is an altitude value for a mountain to be displayed 
on the screen, while the magnitude S of the sounds is normalized in a 
range of 0 to 1. 

10 The object generating unit 102a changes the colors of mesh 

data that forms the mountain object according to the color changing 
threshold I (S1803). 

In this way, in the fifth embodiment, the object generating unit 
102a calculates the color changing threshold I based on sound data 

15 obtained from the sound data inputting unit 103 and changes the 
colors of mesh data that forms mountain objects, so that the colors of 
the displayed mountain objects are changed in accordance with the 
magnitude S of sounds. 

FIGS. 21A and 21B are views showing the screen of the map 

20 displaying apparatus according to the fifth embodiment of the present 
invention. FIGS. 21A and 21B show cases where the magnitude S of 
sounds differs. T he map displaying apparatus according to the fifth 
embodiment changes the colors of mountain objects displayed on the 
screen in accordance with the magnitude S of sounds. It should be 

25 noted that a mountain 1902 displayed on a screen 1901 of the map 
displaying apparatus shows the case where the altitude value is set at 
3,000m. 

When the magnitude S of sounds is high, the object generating 
unit 102a sets a color change line 1903 near the summit of the 
30 mountain object 1902 since the color changing threshold I approaches 
3000m that is the altitude value Hconst. On the other hand, when the 
magnitude S of sounds is low, the object generating unit 102a sets a 
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color change line 1904 towards the foot of the mountain object 1902, 
at around 1500m for example, since the color changing threshold I 
falls below 3000m that is the altitude value Hconst. 

The object generating unit 102a changes colors of mesh data of 
5 mountain objects in accordance with the color changing threshold I, so 
that as shown in FIGS. 21A and 21B, the colors of mountain objects 
change in accordance with the magnitude S of sounds. 

In this way, according to the map displaying apparatus 
according to the fifth embodiment, it is possible to change the colors of 

10 mountain objects that are map display objects according to an input of 
sound data composed of a magnitude of sounds, frequency 
components, and the like, so that the user of the map displaying 
apparatus can visually grasp the sound quality of the audio and the 
audio input status at the same time as the map display. Also, the 

15 map displaying apparatus a ccording to the fifth embodiment can 
change the screen display, such as colors, in accordance with sounds 
even for a map display with a large scale, so that the screen of a map 
displaying apparatus can be made more versatile. 

It should be noted that although the case where the colors of 

20 mountain objects are changed in accordance with sound data is 
described in the fifth embodiment, the present invention is not limited 
to this, and it is also conceivable to change the shapes, for example, of 
mountain objects in accordance with changes in the sound data. 

25 Sixth Embodiment 

Next, a sixth embodiment of the present invention will be 
described. A map displaying apparatus according to the sixth 
embodiment changes a projection transformation matrix using sound 
data from the sound data inputting unit 103. 

30 FIG. 22 is a block diagram showing part of the construction of a 

map displaying apparatus according to the sixth embodiment of the 
present invention. A projection transformation matrix generating unit 
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2001 is connected to the sound data inputting unit 103, generates a 
projection transformation matrix M' based on the obtained sound data, 
and transfers the projection transformation matrix M' to the projection 
transformation unit 104a. 
5 The projection transformation unit 104a carries out projection 

transformation using the projection transformation matrix M' to 
transform the respective vertex coordinates of three-dimensional 
objects to screen coordinates. 

In this way, although the projection transformation unit 104a is 

10 described as using the projection transformation matrix M composed of 
predetermined viewpoint coordinates, a target point position and the 
like in a projection transformation process carried out when generating 
three-dimensional objects from drawing data in the first to fifth 
embodiments described above, in the sixth embodiment, the 

15 projection transformation matrix generating unit 2001 can generate a 
projection transformation matrix M' that has been changed based on 
the sound data from the sound data inputting unit 103, and the 
projection transformation unit 104a can carry out projection 
transformation of vertices of three-dimensional objects using this 

20 projection transformation matrix M'. 

It should be noted that although no description of the specific 
division into regions is given with reference to the drawings in the 
respective embodiments described above, it should be obvious that it 
is possible, for example, to divide the screen in the horizontal direction 

25 into seven equal regions for frequency bands in accordance with high 
and low sounds and to change the display in the respective regions in 
accordance with the sound data. 

In addition, as a modification of the three-dimensional objects 
described above in the embodiments, the three-dimensional objects 

30 could conceivably rotate, jump, twist, etc. in accordance with music, 
and/or be displayed together with a character (such as a female 
character) inviting the user to play some music. 
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In addition, it would be conceivable to carry out a filtering 
process so that only buildings of a predetermined height or higher or 
predetermined types of buildings are changed in accordance with 
music. 

5 As described above, the map displaying apparatus according to 

the present invention includes a map data storage unit operable to 
store map data, a sound data obtaining unit operable to obtain sound 
data, and an image generating unit operable to generate map drawing 
data based on the map data stored in map data storage unit and the 

10 sound data obtained from the sound data obtaining unit. 

The map data stored by the map data storage unit provided in 
the map displaying apparatus according to the present invention may 
be data relating to three-dimensional objects, and the image 
generating unit may change shapes, such as heights, or positions of 

15 the three-dimensional objects based on changes in the sound data. 

This means that it is possible to change the height of 
three-dimensional building objects that are map display objects in 
accordance with an input of sound data, so that the user of the map 
displaying apparatus can visually grasp the sound quality of the audio 

20 and the audio input status at the same time as the map display. 

Also, the map data stored in the map data storage unit may be data 
relating to three-dimensional objects, and the image generating unit 
may change the color data applied to the three-dimensional objects 
based on changes in the sound data. 

25 Accordingly, it is possible to change the color of the 

three-dimensional building objects that are map display objects in 
accordance with an input of sound data, and the user of the map 
displaying apparatus can visually grasp the sound quality of the audio 
and the audio input status at the same time as the map display. 

30 Also, the map data stored in the map data storage unit according to the 
present invention may be data relating to three-dimensional objects 
and the image generating unit may change a display region of 
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three-dimensional objects on the screen based on changes in the 
sound data. 

Accordingly, it is possible to change the display region of the 
three-dimensional objects that are map display objects in accordance 
5 with an input of sound data, and the user of the map displaying 
apparatus can visually grasp the sound quality of the audio and the 
audio input status at the same time as the map display. 

Also, the map data stored in the map data storage unit 
according to the present invention may be data relating to 
10 three-dimensional objects and the image generating unit may carry 
out a process that shakes upper vertices of three-dimensional objects 
based on changes in the sound data and/or may change the mesh color 
data applied to mountain objects based on changes in the sound data. 
As a result, the user of the map displaying apparatus can visually grasp 
15 the sound quality of the audio and the audio input status at the same 
time as the map display. 
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